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(54) MESSAGE OUTPUT CONTROL SYSTEM 

(57)Abstract: 

PURPOSE: To improve the characteristics of a 
man-machine interface by displaying successively 
the easy-to-understand messages after supposing 
that an operator does not understand the input 
operation. 

CONSTITUTION: A time counting means 3 is 
started every time the input operation is carried 
out by an input means 1 and it is judged whether 
the next input operation is carried out or not within 
a prescribed time. If the next input operation is not 
carried out within the prescribed time, it is judged that the input operation is 
not understood. Thus a message is delivered and displayed on a display 
means 2 to induce the next input operation. Then the input operation is carried 
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^ out based on the displayed message as long as the contents of the message 
is uhderstood. If the next input operation is not carried out yet, another 
message is displayed on the means 2 to induce the input operation more 
concretely. In such a way, a message is delivered to induce an input operation 
in response to skillfulness of an operator. 
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Publication of patent application (A) No. 216020/1987 
SPECIFICATION 

1 Title of the Invention 

Message Output Control Mode - ^ ;^ -„ 

2 Scope of Claim for a Patent 

A message output control mode, in an information 
processing apparatus including inputting means (1) , 
displaying means (2), clocking means (3) and a processor 
(4) , the message output control mode comprising: 

performing information processing according to an 
input content from the inputting means (1) and displaying a 
result in the displaying means (2) ; starting clocking by 
using the clocking means (3) every time an input operation 
is carried out; and outputting a message to prompt a next 
input operation and displaying it in the displaying means 
(2) when a time measured by the clocking means (3) exceeds 
a predetermined time. 

3 Detailed Description of the Invention 
[Outline] 

In an information processing apparatus which 
sequentially receives information from inputting means such 
as a keyboard or a tablet to perform information processing 
and displays a result in displaying means, when a 
predetermined time or more is required until a next input 
op^a^4pn, it is di-terfnine^- that operator is 
inexperienced and wavers, and a message to prompt a next 
input operation is displayed in displaying means, thereby 
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constituting an effective man-machine interface for the 
information processing apparatus. 
[Field of the Invention] 

The present invention relates to a message output 
control mode used to display a message to prompt a next 
input operation in an information processing apparatus 
which processes an input content and displays a result. 

With advancement of functions of an information 
processing apparatus, the usability of the information 
processing apparatus is a problem. In order to improve the 
usability, therefore, there is demanded enabling an 
appropriate prompt relative to an operator on the 
information processing apparatus side. 
[Prior Art] 

In various information processing apparatuses, there 
is relatively aboundingly adopted a mode which displays a 
message to guide an input operation by inputting means such 
as a keyboard or a tablet and facilitates the input 
operation. In this case, when the meaning of the displayed 
message cannot be understood, the next input operation is 
impossible, and hence an instruction manual is read or a 
help command is activated. 

Further, in case of the mode which displays a message 
directing a next input operation in accordance with each 
iripit . afcep., fcBere is also known a mode which return:S to an 
initial state as timeout if a next input operation is not 
carried out even after elapse of a predetermined time 
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because the meaning of the displayed message cannot be 
understood like the above example. 

As described above, the prior art information 
processing apparatus, does not take whetherv,;an; operator can 
understand a message into consideration, and executes 
processing according to an input operation within a 
predetermined time. 

[Problems to be Solved by the Invention] 

In case of the mode which activates a help command 
when a displayed message cannot be understood in an input 
operation can be readily carried out by an operator if 
he/she knows its activation method, but an inexperienced 
operator must rely on an instruction manual. Furthermore, 
in case of the mode which returns to the initial state when 
the next input operation is not carried out even after 
elapse of a predetermined time, the input operation must be 
again executed from the beginning, which disadvantageously 
complicates the input operation. 

As described above, since the prior art information 
processing apparatus just passively operates when an 
operator does not know the manipulation, an inexperienced 
operator cannot continue an appropriate input operation. 

It is an object of the present invention to improve 
the characteristic of a man-machine interface by presuming 
that an opgrator cannot understand an input c^eration and: 
sequentially displaying comprehensible messages . 
[Means for Solving Problems] 
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The message output control mode according to the 
present invention determines that an operator does not know 
a next input operation when the next input operation is not 
carried out even after elapse of a predetermined time, and 
outputs a message to prompt the input operation. This 
message output control mode will now be described with 
reference to FIG. 1. An information processing apparatus 
includes inputting means 1 such as a keyboard or a tablet, 
displaying means 2 such as a CRT display device or a liquid 
crystal display unit, clocking means 3 for performing 
clocking by, e.g., counting clock signals, and a processor 
4 which executes processing according to an input content 
and controls the displaying means 2. Information 
processing is effected in accordance with an input content 
from the inputting means 1, and its processing content is 
displayed in the displaying means 2. On the other hand, 
clocking means 3 starts clocking in accordance with each 
input operation from the inputting means 1, and a message 
to prompt a next input operation is outputted and displayed 
in the displaying means 2 when the next input operation is 
not carried out even after measuring a predetermined time. 
[Effects] 

By activating the clocking means 3 in accordance with 
each input operation by the inputting means 1, a judgment 
is made upon whatJh^r- a next input operatron rs earrred out 
within a predetermined time. If the next input operation 
is not performed even after elapse of the predetermined 
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time, it is determined that an operator does not know the 
input operation, and a message to prompt the next input 
operation is outputted. Since this message is displayed in 
the displaying means 2, the- input operation-^i/is^ effected in 
accordance with this message if the operator can understand 
the content of the message. In this case, however, if the 
next operation is not carried out because the operator 
cannot completely understand the message, a further 
concrete message to prompt the input operation is outputted 
and displayed in the displaying means 2. Therefore, a 
message to prompt an input operation is outputted in 
accordance with a level of skill of an operator, thereby 
prompting the input operation. 
[Embodiment] 

An embodiment according to the present invention will 
now be described hereinafter with reference to the 
accompanying drawings . 

FIG. 2 is a block diagram of an embodiment according 
to the present invention, in which reference numeral 10 
denotes a processor (CPU); 11, a timer having a built-in 
processor, which constitutes clocking means 3; 12, a main 
memory; 13, a display control portion; 14, a frame buffer; 
15, a display device such as a CRT display device or a 
liquid crystal display unit which constitutes the 
drsplayihg^ m^^ 16, a buffer; I77 a tablet control 

portion; 18, a driver; and 19 and 20, a tablet and an 
electronic pen constituting inputting means 1. 
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The tablet 19 has a structure in which a plurality of 
transparent electrodes in X and Y directions are provided 
in a transparent substrate for example, and it is mounted 
on a display screen of the .display device. ISr'so: that a 
display content of the display device 15 can be seen 
through the tablet 19. A high-frequency voltages is 
sequentially applied from the driver 18 to the transparent 
electrodes in the X and Y directions in the tablet 19, the 
high-frequency voltage is electrostatically induced to the 
electronic pen 20 when the electronic pen 20 is brought 
into contact with the tablet 19, and the induced voltage is 
supplied to the tablet control portion 17. 

The tablet control portion 17 obtains pointed 
positional information of the electronic pen 20 based on a 
drive timing by the driver 18 and the relationship with a 
phase of the induced voltage, and transfers the pointed 
positional information to the processor 10 through the 
buffer 16. 

The display device 15 is controlled by the display 
control portion 13, and image information in the frame 
buffer 14 is read in accordance with display scanning and 
supplied to the display device 15, thereby displaying this 
image information . 

As the timer 11, a regular timer constituted in the 
pmGe;aa.0r la can^^ The fe^imer 11 is activated in 

accordance with each input operation by the electronic pen 
20, and interrupts the processor 10 when the timeout occurs 
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after performing predetermined clocking. As a result, the 
processor 10 reads an input operation prompting message 
stored in the main memory 12 and supplies it to the display 
control portion 13, and displays this message in the 
display device 15. 

FIG. 3 is an operation explanatory view of the 
embodiment according to the present invention. As 
indicated by (a) , the display screen is divided into a 
document display area and a command display area. This 
example illustrates a case that a letter "h" inputted by 
the electronic pen 20 is displayed in the document display 
area, and so-called icons, i.e., a command indicative of a 
function of an eraser in the upper right part, a command 
indicative of a function of a pen in the upper left part 
and a command indicative of a function of a compass are 
displayed in the command display area. Also, NEXT in the 
lower left part indicates a command requesting display of a 
command in a next page. A desired command can be inputted 
by pointing this command display area by using the 
electronic pen 20. 

When a position of the "eraser" in the command 
display area is pointed by the electronic pen 20, the 
processor 10 identifies that it is an "eraser" command 
input based on the pointed positional information, controls 

display control portion 13 , - anS di splays- only the 
"eraser" part in the command display area in the highlight 
mode. Furthermore, the processor 10 activates the timer 11 



- 7 - 



by this command input. 

If an operator does not perform a next input 
operation since he/she does not know how to use the command 
"eraser" even though he/she has- inputted thisr, cpmrnand, the 
timeout occurs in the timer 11. Based on this timeout, the 
processor 10 reads from the main memory 12 a message to 
prompt a next input operation corresponding to the command 
input content which has activated the timer 11, e.g., "YOU 
HAVE 'ERASER'", transfers it to the display control portion 
13, and again activates the timer 11. 

The display control portion 13 stores display 
information from an area corresponding to the message 
display area, and displays the transferred message in the 
area which is thereby assured. As shown in (b) , the 
message "YOU HAVE 'ERASER'" is displayed in the display 
screen. A shaded part in the command display area 
indicates the highlighted "eraser", and displays a content 
of the currently inputted command. 

If the operator can understand that the electronic 
pen 20 can be used like an eraser based on the displayed 
content of the message, he/she can perform the input 
operator to erase the displayed content in the document 
display area. In this case, if a next input operation is 
not carried out, the timeout again occurs, and the 
proc^ss^^r ID reads f rom -the^- a next prompt 

message corresponding to the command input by which the 
timer 11 is activated, e.g., "YOU CAN ERASE PART OF 
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DOCUMENT", and transfers it to the display control portion 
13. Based on this transferred message, as shown in (c) , 
the message "YOU CAN ERASE PART OF DOCUMENT" is displayed, 
which conveys that the displayed content can be:.:erased by 
the electronic pen 20. 

A message to prompt a next input operation is 
determined in accordance with each input command. When the 
timeout repeatedly occurs with respect to the same input 
command, a content of a message outputted thereby is set so 
that the operator can be informed of the detail of the next 
input operation. 

Moreover, a time value of the timer 11 is set to 
activate the timer 11 every time an input operation is 
carried out. When the time value is subtracted to be zero 
every predetermined time, the timeout occurs, and the 
processor 10 is interrupted. The time value to be set in 
that case can be increased every time a command is used. 
That is, if an operator uses the same command, he/she 
habituates him/herself to its operation. Therefore, the 
time until a prompt message is outputted can be prolonged 
in order to avoid display of an unnecessary message. In 
addition, an increasing rate of the time value to be set 
can be changed in accordance with a learning curve of an 
operator . 

FIG. 4" is an ©xpX^j:aatory view of a set timer value, 
in which a timer value is obtained by sequentially adding a 
fixed value in accordance with a frequency of use of a 
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given command. This drawing shows a case that, when the 
timer value reaches a maximum value MAX, the maximum value 
MAX is then set in the timer 11 as a timer value when 

inputting a command. . :^ , :L^.::::nv^:\. 

Additionally, FIG, 5 is a learning curve view. Since 
individual differences are generated depending on 
capabilities of operators as indicated by curves a, b and c 
the timer value can also be increased in accordance with 
such learning curves. For example, for an operator who can 
quickly improve the level of skill with respect to a number 
of times of use, an increasing rate of the timer value can 
be set large in accordance with the curve a. For an 
operator who is slow in improvement of the level of skill, 
an increasing rate of the timer value can be set small in 
accordance with the curve c. 

Therefore, when an expert performs an operation, a 
message to prompt a next input operation is rarely 
outputted, and an input operation is carried out. When an 
inexperienced operator performs an input operation, a 
message is outputted with a frequency corresponding to the 
level of skill, and the input operation prompted by this 
message can be carried out, thereby improving the man- 
machine interface . 

FIGS. 6A and 6B show basic processing flowcharts at 
th^ ,.tim^ of- the eleGtroniG pen input aec©rd:ing to the 
embodiment of the present invention. When a power supply 
is turned on, the operation is automatically started, and 
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initial setting {l} of a variable is executed. The pen 
input {2} by which an icon is pointed by bringing the 
electronic pen 20 into contact with the tablet 19 or moving 
the electronic pen 20 on. the tablet 19 .for characters and 
the like is processed as pen interruption, and a judgment 
is made upon whether the pen input {2} corresponds to a 
case that the pen is brought into contact with the tablet 
19 (pen-on) or a case that the pen is moved away from the 
tablet 19 (pen-off) . That is, an identification {3} of 
pen-on or pen-off is carried out. In case of pen-on, an 
identification {4} is made upon whether a pen flag PENFLG 
is 0 or 1. The pen flag PENFLG = 0 indicates the pen-off 
on the last occasion, and the pen flag PENFLG = 1 indicates 
the pen-off on the last occasion. 

In case of PENFLG = 0, i.e., the pen-off on the last 
occasion, the pen flag PENFLG is determined as 1, and a 
message type M-SHUTUP is sent to a message output 
processing module MOUTH {s}. That is, stop of output of a 
prompt message is directed to the message output processing 
module MOUTH which outputs the later-described prompt 
message. Then, analysis {6} of a pen-on coordinate is 
carried out, and a judgment is made upon whether the pen-on 
corresponds to a drawing area (document display area in FIG. 
3) or a command area (command display area in FIG. 3) 

If tfig pen- on CO to the dra^A/^ing area , 

processing {?} for the first point according to the pen 
mode is performed. That is, processing is executed with 
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respect to a position at which the electronic pen 20 is 
first brought into contact with the tablet 19. 

Additionally, if the pen-on corresponds to the 
command area, command analysis { 12:} shown in FIGIi '68- is 
performed . 

Further, in the identification {4} of the pen flag 
PENFLG, if PENFLG = 1, i.e., the pen-on on the last 
occasion is confirmed, the pen-on coordinate analysis {8} 
is effected. If that coordinate is in the drawing area, 
processing {9} is carried out for continuous points in 
accordance with the pen mode. That is, since this 
corresponds to the case that the electronic pen 20 is moved 
onto the tablet 19, processing according to the pen mode is 
executed from the previous position to the current position. 

Furthermore, in the coordinate analysis {8}, if the 
coordinate of the pen-on is in the command area, this means 
that the command area is continuously touched by the 
electronic pen 20, the processing waits for the next input. 

Moreover, if the pen-off is confirmed in the 
identification {3} of the pen-on and the pen-off, pen-off 
processing {lO} according to the pen mode is carried out, 
and processing {11} for the pen flag PENFLG = 0 is executed. 

In the command analysis {12}, the command input using 
the icon is analyzed. When the eraser icon in FIG. 3 is 
tonch^d by the elee^^^^ 2:0 and tite command is 

inputted, the eraser icon is identified by the command 
analysis {12} . In addition, when the compass icon is 



- 12 - 



touched by the electronic pen 2 0 and the command is 
inputted, the compass icon is identified by the command 
analysis { 12 } . 

Analysis of a pen mode PENMOD- {13} .is carrred xout by 
identification of the eraser icon. That is, a judgment is 
made upon whether the previous pen mode PENMOD is eraser oi 
others. If the pen mode PENMOD is the eraser, since this 
is the second eraser command input, processing as the same 
as cancel is performed, the icon which highlights 
information that the current command input is the eraser is 
restored, and the pen mode PENMOD = 0 is set {14} . 

Additionally, in cases where any other pen mode is 
identified in the pen mode PENMOD analysis {13} , the icon 
of the current pen mode is restored {15} , the pen mode is 
set to the eraser, and the icon is highlighted {16} . That 
is, as shown in FIG. 3(b), the part of the eraser is 
highlighted . 

Then, as indicated by NUM [eraser] = NUM [eraser] + 1, 
the number of times of use of the eraser icon NUM [eraser] 
is incremented by +1 {17} . This number of times of use of 
NUM [eraser] incremented by +1 is multiplied by a constant 
to calculate a set time TIME {18} . A judgment is made upon 
whether the calculated set time TIME is a maximum value MAX 
{19}. If it is not less than the maximum value MAX, this 

TOxlmum vali^^ Is set as the -&@t time- TTS^ f20) . The 

constant at the step {18} can be set in accordance with the 
level of skill of an operator, and the set time TIME 
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according to the learning curves a, b and c shown in FIG. 5 
can be thereby calculated in accordance with each number of 
times of use. 

When the set time TIME is calculated, to- -thelmessage 
output processing module MOUTH are supplied a message type 
M-SPEAK as well as a first message storing address, a size 
of the first message, a second message storing address, a 
size of the second message and the set time TIME as 
parameters { 21 } . 

FIGS. 7A and 7B show flowcharts of the message output 
processing module MOUTH according to this embodiment of the 
present invention. This message output processing module 
MOUTH has a function to output a prompt message, and 
automatically performs the initial setting (1) of a 
variable when the power supply is turned on. Furthermore, 
the wait mode (2) begins if the set time TIME = 0. 

Moreover, based on message type analysis (3) , 
identification of the above-described message types M-SPEAK 
and M-SHUTUP is carried out. In case of the message type 
M-SPEAK, the set time TIME as the parameter transferred 
together with the message type M-SPEAK is determined as a 
timer value, the wait mode is started (4) , and a judgment 
is made upon whether the timeout of the activated timer is 
generated (5) . 

When the timeout occurs , a judgment is made upon 
whether the status STA = 0 (6) . If STA = 0, a message 
display area is assured (7) . When STA = 1 and after 
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assuring the message display area, the status STA = l is 
determined (8) , image data in an area assured as the 
message display area is saved (9), and the first message is 
displayed in the assured area (10)~ - - ^r.:,^.^,^.. 

Then, the processing waits for a fixed time (11) , and 
the timeout of the fixed time is judged (12) . If the 
timeout is generated, the control advances to processing 
shown in FIG, 7B . 

Moreover, in the message type analysis (3), when the 
message type M-SHUTUP is identified, processing to close 
the message output processing module MOUTH is executed, and 
the status analysis (13) is first performed. If the status 
STA - 0, the processing shifts to the step (2) . If the 
status STA = 1, the saved data is transferred to the 
message display area (14) . In addition, in cases where the 
status STA - 2 and after the step (14) , the area assured in 
the memory is released by a system call FREE, and the 
status STA - 0 is set (15) . 

As described above, when the first message is 
displayed at the step (10) and continuation of this display 
for a fixed time is identified by the timeout (12) , the 
processing advances to a step (16) in FIG. 7B, and the 
saved data is transferred to the message display area. 
That is, after the first message is displayed for a fixed 
-t;ima -a8- shewn Iri FIG. 3 (b) , display returns to^^ the original 
state. Then, the status STA = 2 is set (17), and the wait 
mode (18) begins with the inputted timer value (TIME) . 
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This timer value (TIME) is used to judge whether the 
timeout is generated in the timer (19) . When the timeout 
occurs because of no input by the electronic pen, the 
second message is displayed (-20) . ^ That is, the second - - 
message shown in FIG. 3(c) is displayed. Then, the status 
STA = 1 is determined (21) , the wait mode continues for a 
fixed time (22) , and a judgment is made upon whether the 
timeout of the fixed time is generated (23) . If the 
timeout occurs, the saved data is transferred to the 
message display area (24) . As a result, the original 
display state is restored, the area assured in the memory 
is released by the system call FREE (25) , and the status 
STA - 0 is determined (26) . 

Although the above has described the case that the 
command is inputted by using the icon in the above- 
described embodiment, any other command inputting means can 
be of course used as well. In addition, the above has 
described output and display of up to the second message, 
the third, fourth and other messages can also be outputted 
and displayed. 

[Advantages of the Invention] 

As described above, the present invention can improve 
the man-machine interface because a message to prompt a 
next input operation is outputted and displayed when the 
input o|v©ratic#i is^^^B^^ -ea^rr^ied- -out even after elapse of a 
predetermined time since an operator does not know the next 
input operation, and an appropriate prompt message can be 
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outputted for an inexperienced operator. 
4 Brief Description of the Drawings 

FIG. 1 is a principle block diagram of the present 
invention; FIG. 2 is a block diagram of an embodiment:.;- 
according to the present invention; FIGS. 3(a), (b) and (c) 
are operation explanatory views of the embodiment according 
to the present invention; FIG. 4 is an explanatory view of 
a set timer value; FIG. 5 is a learning curve drawing; FIGS. 
6A and 6B are basic processing flowcharts at the time of 
electronic pen input of the embodiment according to the 
present invention; and FIGS. 7A and B show flowcharts of a 
message output processing module MOUTH of the embodiment 
according to the present invention. 

Reference numeral 1 denotes inputting means; 2, 
displaying means; 3, clocking means; 4 and 10, processors; 
11; a timer; 12, a main memory; 13, a display control 
portion; 14, a frame buffer; 15, a display device; 16, a 
buffer; 17, a tablet control portion; 18, a driver; 19, a 
tablet; and 20, an electronic pen. 
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